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(54) Information imput/output device using touch pane! 

(57) An information input/output device comprising 
a touch panel for displaying key patterns of keyboards 
with various layouts and forms and a virtual mouse ther- 
eon to perform data input and command process when 
the key patterns and virtual mouse displayed thereon 
are touched by the user, a signal detector for detecting 
infrared signals which are generated from the touch 
panel when the key patterns and virtual mouse dis- 
played on the touch panel are touched by the user, a 
position detector for detecting x-y coordinates of a posi- 
tion on the touch panel touched by the user in response 
to the output of the signal detector, a control circuit 
responsive to the x-y coordinates detected by the posi- 
tion detector, for controlling the display of the key pat- 
terns, the virtual mouse and output video information on 
the touch panel according to a set one of a plurality of 
modes, and a touch panel driver for driving the touch 
panel under the control of the control circuit to display 
the key patterns, virtual mouse and output video infor- 
mation thereon. The plurality of modes include a key- 
board display mode, a video display mode and a mouse 
mode. 
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Description 

BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention relates in general to portable, 
small personal information equipment, and more partic- 
ularly to an information input/output device using a 
touch panel in which a key pattern of a keyboard and a 
virtual mouse are displayed on the touch panel, infor- 
mation is inputted by touching the key pattern, and a 
mouse operation is performed when the user picks up 
the virtual mouse with his hand and moves it on the 
touch panel or touches buttons of the virtual mouse. 

Description of the Prior Art 

Referring to Fig. 1 , there is shown a schematic per- 
spective view of a conventional portable, small personal 
information unit, such as a notebook computer, which is 
designated by the reference numeral 1 . As shown in this 
drawing, the notebook computer 1 comprises a key- 
board 3 as data and command input means and a 
mouse 4 coupled with a computer body through a sepa- 
rate connector. The keyboard 3 includes a plurality of 
keys marked with corresponding characters, sines and 
functions. The mouse 4 runs on a mouse pad 5 to move 
a cursor on a liquid crystal display (referred to hereinaf- 
ter as LCD) 2 or it executes commands by having its 
. buttons operated. 

However, conventional portable, small personal 
information equipment such as notebook computers 
must comprise the mouse separately. For this reason, 
the mouse is diff icult to carry and care for. Further, in the 
keyboard, one key may input at least two characters or 
more various characters such as, for example, English, 
Japanese, Korean and etc.. in this case, it is impossible 
to mark one key with all such characters. For the pur- 
pose of providing more various functions by countries, 
companies and models, it is required to individually 
design keyboards with new and various character 
marks. Moreover, when video information to be output- 
ted is large in amount, it must be divided into two or 
three unit pictures for the display thereof on the LCD 
because of a limited size of the LCD. For this reason, 
the information cannot be obviously viewed. 

SUMMARY OF THE INVENTION 

Therefore, the present invention has been made in 
view of the above problems, and it is an object of the 
present invention to provide an information input/output 
device using a touch panel in which key patterns of key- 
boards with various layouts, forms and functions are 
displayed on the touch panel, a desired one of the dis- 
played key patterns is selected and touched for data 
input and command execution, a virtual mouse is dis- 
played on the touch panel, a mouse operation is per- 



formed when the user picks up the virtual mouse with 
his hand and moves it on the touch panel or touches 
buttons of the virtual mouse, and the touch panel is 
used as video information output means, thereby solv- 

5 ing limitations in character marks and layouts of conven- 
tional keyboards, overcoming inconveniences in the 
carrying and care of conventional mouses and being 
capable of displaying various video information on an 
extended screen. 

w In accordance with the present invention, the above 
and other objects can be accomplished by a provision of 
an information input/output device comprising a touch 
panel for displaying key patterns of keyboards with vari- 
ous layouts and forms and a virtual mouse thereon to 

is perform data input and command process when the key 
patterns and virtual mouse displayed thereon are 
touched by the user; signal detection means for detect- 
ing infrared signals which are generated from said touch 
panel when the key patterns and virtual mouse dis- 

20 played on said touch panel are touched by the user; 
position detection means for detecting x-y coordinates 
of a position on said touch panel touched by the user in 
response to the output of said signal detection means; 
control means responsive to the x-y coordinates 

25 detected by said position detection means, for control- 
ling the display of the key patterns, the virtual mouse 
and output video information on said touch panel 
according to a set one of a plurality of modes; and touch 
panel drive means for driving said touch panel under the 

30 control of said control means to display the key patterns, 
virtual mouse and output video information thereon. 

BRIEF DESCRIPTION OF THE DRAWINGS 

35 The above and other objects, features and advan- 
tages of the present invention will be more clearly 
understood from the following detailed description taken 
in conjunction with the accompanying drawings, in 
which: 

40 

Fig. 1 is a schematic perspective view of a conven- 
tional portable, small personal information unit; 
Rg. 2 is a block diagram of an information input/out- 
put device using a touch panel in accordance with 

45 the present invention; 

Rg. 3 A is a perspective view illustrating how the 
information input/output device in Fig. 2 is applied 
to a notebook computer in accordance with a first 
embodiment of the present invention; 

so Rg. 3B is a perspective view illustrating how the 
information input/output device in Fig. 2 is applied 
to the notebook computer in accordance with a sec- 
ond embodiment of the present invention; 
Rg. 4 A is a perspective view illustrating how the 

55 information input/output device in Fig. 2 is applied 
to the notebook computer in accordance with a third 
embodiment of the present invention; 
Rg. 4B is a perspective view illustrating how the 
information input/output device in Fig. 2 is applied 
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to the notebook computer in accordance with a 
fourth embocfiment of the present invention; and 
Fig. 5 is a detailed view of a virtual mouse in 
accordance with the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

Referring to Fig. 2, there is shown a block diagram 
of an information input/output device using a touch 
panel in accordance with the present invention. As 
shown in this drawing, the information input/output 
device comprises a first LCD 10 for displaying output 
video information and a cursor thereon. 

The touch panel, designated by the reference 
numeral 20, is used to display key patterns of keyboards 
with various layouts and forms and a virtual mouse ther- 
eon. The touch panel 20 performs data input and com- 
mand process when the key patterns and virtual mouse 
displayed thereon are touched by the user. 

The information input/output device further com- 
prises a signal detector 30 for detecting infrared signals 
which are generated from the touch panel 20 when the 
key patterns and virtual mouse displayed on the touch 
panel 20 are touched by the user, a position detector 40 
for detecting x-y coordinates of a position on the touch 
panel 20 touched by the user in response to the output 
of the signal detector 30, a mode setting unit 50 for set- 
ting a keyboard display mode, a video display mode and 
a mouse mode according to a user's selection, and a 
control circuit 60 for discriminating a key of the touched 
position and whether buttons of the virtual mouse have 
been touched by the user, in response to the x-y coordi- 
nates detected by the position detector 40, and output- 
ting the discriminated result to a microprocessor MP. 
The control circuit 60 also controls the display of the key 
patterns, virtual mouse and output video information on 
the touch panel 20 and the display of the output video 
information and cursor on the first LCD 10. 

The information input/output device further com- 
prises a touch panel driver 70 for driving the touch panel 
20 under the control of the control circuit 60 to display 
the key patterns, virtual mouse and output video infor- 
mation thereon, and a first LCD driver 80 for driving the 
first LCD 10 under the control of the control circuit 60 to 
display the output video information and cursor thereon. 

The touch panel 20 includes a second LCD 21 for 
displaying the key patterns, virtual mouse and output 
video information thereon, a first transmitter 22 for gen- 
erating the infrared signal for the detection of the x-coor- 
dinate, a second transmitter 23 for generating the 
infrared signal for the detection of the y-coordinate, a 
first receiver 24 for receiving the infrared signal from the 
first transmitter 22, and a second receiver 25 for receiv- 
ing the infrared signal from the second transmitter 23. 

The control circuit 60 includes a movement discrim- 
inator 61 for discriminating present and moved positions 
of the virtual mouse in response to the x-y coordinates 
detected by the position detector 40, a button discrimi- 



nator 62 for discriminating whether the buttons of the 
virtual mouse have been touched by the user, in 
response to the x-y coordinates detected by the position 
detector 40, and outputting the discriminated result to 

5 the microprocessor MP, and an input/output controller 
63 for discriminating the key of the touched position in 
response to the x-y coordinates detected by the position 
detector 40 and outputting the resultant key input com- 
mand to the microprocessor MP. The input/output con- 

10 troller 63 also inputs the output video information 
processed by the microprocessor MP and controls the 
touch panel driver 70 and the first LCD driver 80 in 
response thereto. 

The control circuit 60 further comprises a memory 

is 64 for storing the key patterns of the keyboards with the 
various layouts and forms and the corresponding posi- 
tion information therein. 

The operation of the information input/output device 
with the above-mentioned construction in accordance 

20 with the present invention will hereinafter be described 
in detail. 

The keyboard display mode is defined as displaying 
the key patterns on the touch panel 20 and using the 
touch panel 20 as the keyboard. The video display 
25 mode is defined as using the touch panel 20 with the 
first LCD 10 as video display means. The mouse mode 
is defined as displaying the virtual mouse on the touch 
panel 20. 

The keyboard display mode is automatically set at 

30 the beginning of a booting operation. In this case, the 
key patterns of the keyboards with the various layouts 
and forms are applied from the memory 64 in the control 
circuit 60 to the second LCD 21 in the touch panel 20 
and displayed thereon. A desired one of the displayed 

35 key patterns is touched by the user and displayed on the 
second LCD 21. A video display mode button is dis- 
played on a desired position of the displayed key pattern 
so that it can be touched by the user to set the video dis- 
play mode. The video display mode can also be set by 

40 the mode setting unit 50. 

First, when the keyboard display mode is initially set 
automatically or set by the mode setting unit 50, the 
input/output controller 63 in the control circuit 60 reads 
the key patterns of the keyboards with the various lay- 

45 outs and forms stored in the memory 64 and controls 
the touch panel driver 70 to display the read key pat- 
terns on the second LCD 21 in the touch panel 20. 

When the desired key pattern is touched by the 
user, the first and second transmitters 22 and 23 in the 

so touch panel 20 are driven by the signal detector 30 to 
generate the infrared signals, which are received by the 
first and second receivers 24 and 25, respectively. The 
infrared signals from the first and second receivers 24 
and 25 are detected by the signal detector 30 and sup- 

55 plied to the position detector 40. 

The position detector 40 detects the x-y coordi- 
nates of the touched key pattern position in response to 
the output of the signal detector 30 and supplies the 
detected result to the control circuit 60. Then in the con- 
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trol circuit 60, the inputfoutput controller 63 compares 
the detected result from the position detector 40 with the 
position information of the various key patterns stored in 
the memory 64 to determine which one of the key pat- 
terns in the memory 64 has been touched. The 
input/output controller 63 then supplies the determined 
result to the microprocessor MR The input/output con- 
troller 63 also controls the touch panel driver 70 to dis- 
play the selected key pattern on the second LCD 21 in 
the touch panel 20. 

Fig. 3A is a perspective view illustrating how the 
information input/output device in Fig. 2 is applied to a 
notebook computer in accordance with a first embodi- 
ment of the present invention. In this embodiment, a 
selected key pattern can be displayed on the second 
LCD 21 in the touch panel 20. The user can touch a 
desired key on the touch panel 20 for data input and 
command execution. 

When a desired key on the touch panel 20 is 
touched by the user, the first and second transmitters 22 
and 23 in the touch panel 20 are driven by the signal 
detector 30 to generate the infrared signals. The first 
and second receivers 24 and 25 receive the infrared sig- 
nals from the first and second transmitters 22 and 23, 
respectively. The infrared signals received by the first 
and second receivers 24 and 25 are detected by the sig- 
nal detector 30 and supplied to the position detector 40. 

The position detector 40 detects the x-y coordi- 
nates of the touched key position in response to the out- 
put of the signal detector 30 and supplies the detected 
result to the control circuit 60. Then in the control circuit 
60, the input/output controller 63 compares the detected 
result from the position detector 40 with the key position 
information of the selected key pattern stored in the 
memory 64 to determine which key of the selected key 
pattern in the memory 64 has been touched. The 
input/output controller 63 then supplies the resultant key 
input command to the microprocessor MP which ana- 
lyzes it to perform the corresponding work. 

In this manner, the user can use the touch panel 20 
as the keyboard and touch the key pattern displayed on 
the second LCD 21 therein to perform a sequence of 
works. 

Thereafter, when the video display mode is set by 
the mode setting unit 50 or by the user touching the 
video display mode butt6n displayed on a desired posi- 
tion of the selected key pattern, the input/output control- 
ler 63 in the control circuit 60 determines the present 
mode as the video display mode. In this case, the 
input/output controller 63 controls the touch panel driver 
70 to erase the key pattern displayed on the second 
LCD 21 in the touch panel 20. Also, the inputfoutput 
controller 63 inputs the video information from the 
microprocessor MP and controls the touch panel driver 
70 to display the inputted video information on the sec- 
ond LCD 21 in the touch panel 20. 

Fig. 3B is a perspective view illustrating how the 
information input/output device in Fig. 2 is applied to the 
notebook computer in accordance with a second 



embodiment of the present invention. In this embodi- 
ment, the video information from the microprocessor 
MP can be displayed on the second LCD 21 in the touch 
panel 20 as well as the first LCD 10. This has the effect 

5 of providing an extended screen area. 

Fig. 4 A is a perspective view illustrating how the 
information input/output device in Fig. 2 is applied to the 
notebook computer in accordance with a third embodi- 
ment of the present invention. A "mouse execution but- 

10 ton" is automatically displayed on a desired position of 
the second LCD 21 in the touch panel 20 at the begin- 
ning of the booting operation. When the user would like 
to perform a mouse operation, he can set the mouse 
mode by touching the mouse execution button with his 

15 hand or using the mode setting unit 50. 

If the mouse mode is set in the above manner, the 
movement discriminator 61 in the control circuit 60 
determines the present mode as the mouse mode and 
controls the touch panel driver 70 to display an initial 

20 picture of the virtual mouse on the second LCD 21 in the 
touch panel 20. The movement discriminator 61 also 
controls the first LCD driver 80 to display the cursor on 
a position 81 of the first LCD 10 corresponding to the ini- 
tial virtual mouse position 71 on the second LCD 21 in 

25 the touch panel 20. 

The initial virtual mouse picture is displayed on the 
right-side lower portion 71 of the second LCD 21 and 
has left and right button regions 91 and 92 spaced apart 
from a central reference point 90 by a predetermined 

30 distance, as shown in Fig. 5. The mouse operation is 
performed when the user picks up the virtual mouse 
with his hand and moves "rt on the touch panel 20 or 
touches the button regions 91 and 92 of the virtual 
mouse. 

35 When the user picks up the virtual mouse with his 
hand and moves it on the second LCD 21 in the touch 
panel 20 from the initial position 71 to a desired position 
72, the first and second transmitters 22 and 23 in the 
touch pane! 20 are driven by the signal detector 30 to 

40 generate the infrared signals, which are received by the 
first and second receivers 24 and 25, respectively. The 
infrared signals from the first and second receivers 24 
and 25 are detected by the signal detector 30 and sup- 
plied to the position detector 40. 

45 The position detector 40 detects the x-y coordi- 
nates of the touched position in response to the output 
of the signal detector 30 and supplies the detected 
result to the control circuit 60. Then in the control circuit 
60, the movement discriminator 61 compares the 

so detected coordinates from the position detector 40 with 
the previous coordinates to determine whether the vir- 
tual mouse has been moved. 

If the detected coordinates from the position detec- 
tor 40 are the same as the previous coordinates, the 

55 movement discriminator 61 determines that the virtual 
mouse has not been moved. In this case, the movement 
discriminator 61 controls the touch panel driver 70 to 
continue to display the initial virtual mouse picture as 
shown in Fig. 5 on the right-side lower portion 71 of the 
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second LCD 21 in the touch panel 20. On the other 
hand, when the detected coordinates from the position 
detector 40 are not the same as the previous coordi- 
nates, the movement discriminator 61 determines that 
the virtual mouse has been moved. In this case, the 
movement discriminator 61 controls the touch panel 
driver 70 to display the virtual mouse on the new posi- 
tion 72 of the second LCD 21 in the touch panel 20. 

The movement discriminator 61 also controls the 
first LCD driver 80 to display the cursor on a position 82 
of the first LCD 10 corresponding to the new position 72 
on the second LCD 21 in the touch panel 20. 

When the button regions 91 and 92 of the virtual 
mouse are touched by the user under such a condition, 
the first and second transmitters 22 and 23 in the touch 
panel 20 are driven by the signal detector 30 to gener- 
ate the infrared signals, which are received by the first 
and second receivers 24 and 25, respectively. The infra- 
red signals from the first and second receivers 24 and 
25 are detected by the signal detector 30 and supplied 
to the position detector 40. 

The position detector 40 detects the x-y coordi- 
nates of the touched position in response to the output 
of the signal detector 30 and . supplies the detected 
result to the control circuit 60. Then in the control circuit 
60. the button discriminator 62 discriminates the x-y 
coordinates detected by the position detector 40 and 
outputs the discriminated result to the microprocessor 
MP. In this case, the output signal from the button dis- 
criminator 62 is the same as a signal generated when 
the actual mouse buttons are operated. The microproc- 
essor MP analyzes the output signal from the button 
discriminator 62 and performs a control operation in 
accordance with the analyzed result. 

On the other hand, when the user would like to stop 
the mouse operation, he can accomplish it by touching 
the mouse execution button with his hand or using the 
mode setting unit 50 to apply a mouse mode release 
signal to the control circuit 60. In response to the mouse 
mode release signal, the control circuit 60 controls the 
touch panel driver 70 and the first LCD driver 80 to 
release the mouse mode. 

As apparent from the above description, according 
to the present invention, the key patterns of the key- 
boards with various layouts, forms and functions are 
displayed on the touch panel and a desired one thereof 
is selected and touched for the data input and command 
execution. The virtual mouse is displayed on the touch 
panel and the mouse operation is performed when the 
user picks up the virtual mouse with his hand and 
moves it on the touch panel or touches the buttons of 
the virtual mouse. Therefore, the present invention is 
capable of solving limitations in character marks and 
layouts of conventional keyboards and overcoming 
inconveniences in the carrying and care of conventional 
mouses. Further, the touch panel is used as the video 
information output means, so that various video infor- 
mation can be displayed on the extended screen. 



Although the preferred embodiments of the present 
invention have been disclosed for illustrative purposes, 
those skilled in the art will appreciate that various mod- 
ifications, additions and substitutions are possible, with- 
5 out departing from the scope and spirit of the invention 
as disclosed in the accompanying claims. 

Claims 

w 1. An information input/output device comprising: 

a touch panel for displaying key patterns of 
keyboards with various layouts and forms and a vir- 
tual mouse thereon to perform data input and com- 
mand process when the key patterns and virtual 

is mouse displayed thereon are touched by the user; 

signal detection means for detecting infrared 
signals which are generated from said touch panel 
when the key patterns and virtual mouse displayed 
on said touch panel are touched by the user; 

20 position detection means for detecting x-y 

coordinates of a position on said touch panel 
touched by the user in response to the output of 
said signal detection means; 

control means responsive to the x-y coordi- 

25 nates detected by said position detection means, 
for controlling the display of the key patterns, the 
virtual mouse and output video information on said 
touch panel according to a set one of a plurality of 
modes; and 

30 touch panel drive means for driving said 

touch panel under the control of said control means 
to display the key patterns, virtual mouse and out- 
put video information thereon. 

35 2. An information input/output device as set forth in 
Claim 1 , further comprising: 

a first LCD for displaying the output video 
information and a cursor thereon; 

first LCD drive means for driving said first 
40 LCD under the control of said control means to dis- 
play the output video information and cursor ther- 
eon; and 

mode setting means for setting one of said 
plurality of modes according to a user's selection, 
45 said plurality of modes including a keyboard display 
mode, a video display mode and a mouse mode. 

3- An information input/output device as set forth in 
Claim 1, wherein said plurality of modes include a 

so keyboard display mode, a video display mode and a 
mouse mode, said keyboard display mode being 
automatically set at the beginning of a booting oper- 
ation, said video display mode being set by the user 
touching a video display mode button displayed on 

55 a desired position of said touch panel during said 
keyboard display mode, said mouse mode being 
set by the user touching a mouse execution button 
displayed on a desired position of said touch panel 
at the beginning of the booting operation. 
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4. An information input/output device as set forth in 9. 
Claim 3, wherein said plurality of modes are set by 

mode setting means. 

5. An information input/output device as set forth in s 
Claim 2, wherein said touch panel includes: 

a second LCD for displaying the key pat- 
terns, virtual mouse and output video information 
thereon; 

a first transmitter for generating the infrared 10 
signal for the detection of the x-coordinate; 

a second transmitter for generating the infra- 
red signal for the detection of the y-coordinate; 

a first receiver for receiving the infrared sig- 
nal from said first transmitter; and is 

a second receiver for receiving the infrared 
signal from said second transmitter. 

6. An information input/output device as set forth in 
Claim 1 t wherein said control means includes: 20 

a movement discriminator for discriminating 
a moved position of the virtual mouse in response 
to the x-y coordinates detected by said position 
detection means, generating a control signal as a 
result of the discrimination and outputting the gen- 25 
erated control signal to said touch panel drive 
means; 

a button discriminator for discriminating 
whether buttons of the virtual mouse have been 
touched by the user, in response to the x-y coordi- 30 
nates detected by said position detection means, 
and outputting the discriminated result to a micro- 
processor; 

an input/output controller for discriminating a 
key of the touched position in response to the x-y 35 
coordinates detected by said position detection 
means and outputting the resultant key input com- 
mand to said microprocessor, said input/output 
controller inputting the output video information 
from said microprocessor, generating a control sig- 40 
nal in response thereto and outputting the gener- 
ated control signal to said touch panel drive means; 
and 

a memory for storing the key patterns of the 
keyboards with the various layouts and forms and 45 
the corresponding position information therein. 

7. An information input/output device as set forth in 
Claim 5, wherein said second LCD displays the out- 
put video information thereon with said first LCD in so 
the video display mode. 

8. An information input/output device as set forth in 
Claim 1, wherein said touch panel has an input 
function based on the touch of the user and an out- 55 
put function for outputting the output video informa- 
tion. 



An information input/output device as set forth in 
Claim 2, wherein said mouse mode is performed 
when the virtual mouse is displayed on said touch 
panel and the user picks up the virtual mouse with 
his hand and moves it on said touch panel or 
touches buttons of the virtual mouse. 
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